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This paper is concerned with the statistical properties of the output 
y(t) of a periodically varying linear system when the input is random 
shot noise. 

Usually y(t) can be divided into a noise part, y N (t), and a periodic part, 
y DeT (t). Expressions are obtained for the Fourier components of y per (t) 
and the power spectrum of yit(t). Various averages associated with y(t) 
are studied. Some of the results for shot noise input can be converted into 
corresponding results for white noise input. 

Some of the theoretical results are illustrated by applying them to two 
examples. In both examples the system consists of an arrangement of a 
resistance, a condenser, and a switch which opens and closes periodically. 
The output is the voltage across the condenser. 

I. INTRODUCTION 

Consider a circuit, shown in Fig. la, consisting of a resistance R 
shunted by a switch and condenser C. The circuit is driven by a Pois- 
son shot noise current. The elementary charges q arrive at random at 
an average rate of v per second. The switch operates in a cycle with 
period T. It is closed during the intervals nT < t < nT + aT and 
open during the intervals nT + aT < t < (n + \)T where n is an 
integer and < a < 1. We are interested in the statistical properties 
of the voltage V(t) across the condenser. In particular, we want an 
expression for the two-sided power spectrum W r (f) of V(t). 

This problem was encountered by D. D. Sell 1 during the develop- 
ment of a new type of spectrophotometer. The determination of an 
exact expression for W v (f) turned out to be unexpectedly difficult, 
and led to the present investigation of the more general case in which 
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Fig. 1 — RC circuits with periodically operating switch. 

the switched RC circuit is replaced by a general linear network which 
varies periodically with time. 

The systems shown in Fig. 1 are "cyclo-stationary" (this term was 
introduced by W. R. Bennett). Cyclo-stationary systems have been 
studied by a number of writers. A detailed treatment and many ref- 
erences are given by H. L. Hurd 2 in his thesis on periodically cor- 
related stochastic processes. However, I have been unable to find any 
references dealing specifically with periodically varying systems hav- 
ing shot noise input. The nearest approach is contained in seven pages 
of anonymous handwritten notes 3 obtained by Sell. These notes give 
approximate results for the case of Fig. la with white-noise input 
instead of shot noise input. 

In Section II, we make some general remarks about the notation 
and type of analysis used in this paper. Section III contains a state- 
ment of results for the general system shown in Fig. 2. In Sections 
IV and V, the general results are applied to the RC circuits shown 
in Figs, la and lb. Representative curves giving W v (f) for various 
values of the circuit parameters in Fig. la are plotted in Fig. 3. Sec- 
tions VI, VII, and VIII contain the derivation of the expressions stated 
in Section II for the various ensemble averages and the output power 
spectrum. The results for shot noise input can be carried over into cor- 
responding results for white gaussian noise input. This correspondence 
is developed in Section IX. Appendix A gives an outline of the 
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analysis required in applying the general theory to get the power 
spectrum W r (f) of the output V(t) in the RC circuit of Fig. la. 

Roughly speaking, the shot effect formulas for a periodically vary- 
ing system differ from the shot-effect formulas for a time invariant 
system 4 by containing an additional integration. This extra integral 
represents an average taken over the period. 

II. REMARKS CONCERNING NOTATION AND ANALYSIS 

In this paper ensemble averages are denoted by the angle bracket 
< ) and time averages by over-bars. For example, consider V(t) in Fig. 1. 
We can write V(t) = V(t, <p) where <p represents the family of random 
arrival times of the charges q comprising the shot noise current. When t 
is held fixed, V(t) can be regarded as a random variable and (V l (t)) 
as the average value of the Zth power of V(t) at time t. On the other hand, 
for a fixed set <p of arrival times, i.e., for a particular member of the 
ensemble, the time average of V'(t) is denoted by 

T\t) = limit 7jr f ' V'(t)dt. (1) 

Let z{t) be an output function (e.g., V l {t) ) of our periodic system such 
that its ensemble average (z(t)) is periodic with pe riod T, the period of 
the system. We assume that the time average z(t) has the same 
value for almost all members of the ensemble. From this assumption 
and the periodicity of (z(t)) it follows, upon averaging both sides of 
the equation 

1 r Tl 

z(t) = limit ^ / «(0 dt 

over the ensemble, that 

i(5 = f [ <*(0> dt. (2) 

In addition to ensemble and time averages, we shall use E to denote 
expected values of time invariant random variables associated with 
the amplitudes of the shot noise impulses. 




Fig. 2 — Time-varying linear system specified by h(t, r). 
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Fig. 3 — Power spectrum of V(t) in Fig. la. 

W V M) = 2-sided power spectrum of 7(0 minus DC spike due to Vde = v qR. 
I(t) = £*<?S(< - **), v = Arrival Rate, y - 1/(RC); 
a = Fraction of time switch is closed; 
T = Length of switch cycle; 
(a, yT) = Curve parameters. 



We use the term "periodic" to mean "singly periodic." The more 
difficult case of "multiply periodic" variation is not considered. An 
example of the latter is given by the circuit of Fig. la in which the 
switch is operated by the function j{t) = P cos pt + Q cos qt, p and 
q being incommensurable. The switch is closed when f(t) > 0, and is 
open when f(t) < 0. Possibly such cases could be handled by the 
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method used by Bennett"' to obtain the output of a rectifier when P cos 
pt + Q cos qt is applied. 

The (two-sided) power spectrum W v (f) [where W v (—f) = W v {f)] 
can be interpreted physically as follows. Let V(t) be applied to an 
ideal filter which passes only the narrow band /i < |/| < /i + A/, 
and let the filter be terminated in a resistance of one ohm. Then 

[Wy(-U) + Wy(h)] A/ = 2Wy(U) A/ 

is the time average of the power which would be dissipated in the 
one ohm resistance. The average must be taken over an interval long 
in comparison with 1/A/. 

The analysis used here makes no attempt at mathematical rigor. 
Orders of summation and integration are interchanged freely, and 
assumptions are made which are physically plausible but which may 
be difficult to express in precise mathematical terms. 

III. STATEMENT OF RESULTS FOR GENERAL SY'STEM 

The results given in this section pertain to the general system shown 
in Fig. 2. The system is linear and is specified by the response y(t) 
= h(t, t) to a unit impulse x(t) = 8(t — t) applied at time t. The 
system varies periodically with period T so that 

h(t + nT, t + nT) = h(t, t) n = integer. (3) 

In most of our work, the input x{t) is the shot noise 



.T 



(/) = E «*«(/ - h) (4) 



*--' 



where the random "arrival times" t K occur at an average rate of 
v/second and constitute a Poisson process. The impulse amplitudes a k 
are independent random variables with 

E(a k ) = E(a), E{a\) = E(a 2 ). (5) 

Since the system is linear, the output corresponding to equation (4) is 

y(t) = E aMt,t k ). (6) 

The function h(t, t) is assumed to be such that the steps in the 
analysis are legitimate. In particular, it is assumed that when < 
t < T and \t\ -» °o, \h{t, t) | tends to with sufficient rapidity to 
(i) make the various integrals converge, and (it) ensure that the 
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times at which a long interval of operation begins and stops have 
no appreciable influence on the output during the major portion of 
the interval. 

In Section VIII it is shown that y(t) is the sum of a noise com- 
ponent y N (t) and a periodic (including dc) component y peT (t): 

y(t) = y N (0 + ft.,(0. (7) 

The power spectrum of yu(t) is 

W..(S) = ^P [ | .(/, r) r At (8) 

where 

s (j, T ) = f e - ia, h(t, t) dt, cu = 2tt/. (9) 

The periodic component of y{t) is 

(10) 
= v E{a)sM + 2vE(a) Real £ s (m/T)e i2wm " T , 
where 

«.(/) = ± f* 8(J, t) dr. (11) 

The dc part of ?/(£) is given by the constant term in equation (10) : 

y d0 = vE(a)s (0). (12) 

Note that y^r (0 is zero when E(a) is zero. 

The ensemble average (y l (t)), which gives the Ith moment of the 
distribution of the ensemble of y(t)'s at time t, is a periodic function 
of t of period T. For Z = 1 and I = 2 

<7/(/)> = *E(a) E f fe(/ + n7\ r) d T| (13) 

n--eo JO 
n--co Jo 

These equations give the first and second cumulants of the distribu- 
tion of the y (t) 's. The Ith cumulant at time t is 

Kl (f) = vE{a l ) 2 f W + nT < t) dT - ( 15 ) 

„=-■= Jo 

The periodic and noise components of y(t) are related to the ensemble 
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averages by 

y,M - (y(t)) = Kx (0, (16) 

(yM = (y 2 (t))-W)) 2 = K>(t). (17) 

The mean square value of y£(t), averaged over time, may be expressed 
in several ways: 

yW) = ff Q T W0» dt = ^[ «M dt > 
yW) = f W VK (j) dj, 

•/ — CO 

-^p-f'drf m dth\t,r). (18) 

All of the foregoing results pertain to the case in which the input 
x{t) is the shot noise (4). Now let the input be zero-mean white 
gaussian noise with the power spectrum 

WM - \ No ' ' ' ' < F ' <«» 



,0, . \f\> F; 

where F —► » . It is shown in Section IX that results for this input can 
be obtained from the preceding shot noise formulas by taking a k = 
iCAToA)* with equal probability and letting v — » «. Then 

^(a) -» 0, ^(a 2 ) -» No , and ^(a 1 ) -> for I > 2. (20) 

Therefore ?/ por (0 = <i/(0> = 0, and consequently y(«) consists entirely 
of the noise component y N (t). Expressions for th e output power spectrum 
W y (j) and the mean square values (y 2 (t)), y 2 (t) are obtained by replacing 
vE(a 2 ) by N in equations (8), (14), and (18): 

W v (i) = & [ I stf, r) | 2 dr, 

W)> = A r o E ( ^"(^ + »r. ') dr, 

n--to Jo 

= Y f dT fj th2{l ' T) - (21) 
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In these expressions, s(f, t) is still the Fourier transform (9) of 
h(t, t). Equations (15) and (20) show that all of the cumulants 
except the second are zero. Therefore the ensemble of y(t)'s at time 
t is normally distributed about with variance (y 2 (t)) given by 
equation (21). The probability that y{t) will lie between Y and Y 
+ dF at a time t picked at random is given by expression (113) in 
Section IX. 

IV. RC CIRCUIT OF FIGURE la 

In this section the results stated in Section III for general systems 
will be applied to the RC circuit shown in Fig. la. In this case the 
input x{t) is the input I(t) from the shot-noise current generator, 

/(*) = E qKt - h) (22) 

where the individual charges (of q coulombs) arrive at an average rate 
of v per second. 

Comparison with the series (4) for x{t) shows that a k = q and 

E(a) = q, E(a 2 ) - q\ (23) 

The output V(t) is constant for intervals of length (1 — a)T while 
the switch is open. When the switch is closed V(t) drifts either up or 
down, depending upon whether the input current is temporarily greater 
than or less than the leakage through R. The average value of V(t) 
is Vdc = vqR where vq is the average current flowing through R. It turns 
out that the mean square value of V(t) — V de is qV dc /(2C). Furthermore, 
the circuit of Fig. la is unusual in that the distribution of the ensemble 
of V(t)'s at time t does not vary periodically with t. 

Some insight into the behavior of the system can be obtained by con- 
sidering the case when T/RC <<C 1. If the switch were closed all of the 
time (a = 1), the usual shot effect formulas would hold and the two- 
sided power spectrum of V(t) would be 



W V (J) = v \f e- iat F(t) dt 
vg 2 R 2 



1 + (co RC)' 



+ VI 8(f), 
- VI 8(f), co = 2rf, 



where F{t) is the V(t) due to a charge q arriving at time 0; F(t) = 
(q/C) exp (-t/RC) for t > 0, and F(t) = for t < 0. The first term in 
Wv(f) is Wv N (f), the power spectrum of the noise component V N (t) = 
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V(t) - 7 d0 , and the second term is the spike due to V d0 . Now, instead 
of a = 1 let a be anywhere in < a < 1, but take T/RC « 1. The 
cycles are so brief that V(t) does not change much during one cycle; 
and the situation is much like that for a = 1 except that, in effect, v is 
reduced to va, and F(t) becomes (q/C) exp (-te/RC) because the 
condenser current flows only the fraction a of the time. Replacing v 
by va and Fit) by its new expression leads to 

W V A1) ~ ! + (w RC/a)2 

When T/RC is not small, the expressions for the power spectrum 
become much more complicated. We now turn to the general case in 
which T/RC and a are unrestricted except for < a < 1. 

The first step is to determine the response (the condenser voltage) 
hit, t) at time t to a unit impulse of current arriving at time t where 
< t < T. When a T < r < T, the impulse arrives when the switch 
is open, no charge reaches the condenser, no voltage appears across 
the condenser, and hence 

h(t, r) = for all t when aT < r < T. (24) 

When < t < aT the switch is closed, and the unit impulse of 
current arriving at time t deposits a unit charge on the condenser. 
This charges the condenser to the voltage l/C. The voltage decreases 
exponentially as the charge leaks off through R until the switch opens 
at time aT. The voltage remains constant throughout the interval aT 

< t < T during which the switch is open. It resumes its exponential 
decay during T < t < T + aT, remains constant during T + aT < t 

< 2T, and so on. Hence when < r < aT the values of hit, t) are 

0, -oo < t < t; 

(T 1 exp [- T (/ - t)], t < t < aT; (25) 

C _1 exp [-yinaT - r)], in - \)T + aT < t < nT; 

(T 1 exp [-yinaT - r) - y(t - nT)], nT < t < nT + aT; 
where n = 1,2,3, •• • and 

7 = 1/(RC). (26) 

Equation (6) for the output yit) becomes 

Vit) = f) qhit, /,) (27) 
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where h(t, t k ) can be obtained from the relation h(t + nT, r + nT) = 
h(t, t) and the values (24) and (25). From equation (9), the Fourier 
transform s(f, r) of h(t, r) is when aT < r < T because, from (24), 
h(t, t) is in the same interval: 

s(/, r) = 0, aT < r <T. (28) 

For < t < aT we have, from equations (9) and (25) , 

s(j, t) = J e" tut h(t, t) dt, <* = 27r/; 

= J C~ x exp [~y(t - T ) - uat] dt 

+ £ (T 1 exp [- 7 (n«r - r)] 

71-1 

x(f 9"""dt+ r * e- y(t - nT) - i " t dt)- (29) 

When the integrations are performed, the series summed, and the 
notation 

z = e- iaT , b - «-*- r (30) 

introduced, some algebra carries equation (29) into 

*(f. 7") = — T— — + -j r- (z - z )l — — — (31) 

7 + ?u 1 — 02: Vy + 7o> W v ' 

for < t < aT. 

The integral (11) fors (/) becomes 



i r T 

Soil) = 7p J s(f, t) dr, u = 2tt/; 

i r T 

= ^J o s(/,r)dr. 



(32) 



The function s (/) is used solely to compute the periodic portion of 
the output, and therefore only the values of s (m/T), where m is an 
integer, are of interest. For / = m/T the value of w = 2wf is w = 2irm/T, 
and <oT = 2-wm. Evaluation of the integral (32) for s (/) leads to 

«m = i/(Or) - b, (33) 

s (ra/T) - 0, rn^O. 
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As in equation (7), the output V(t) can be expressed as the sum of 
a noise component and a periodic component, 

V(t) = V N (t) + V Det (t). (34) 

Since s (in/T) is zero for m 9^ 0, equation (10) shows that for Fig. la, 
the periodic component consists only of the dc component: 

V w ® = V d0 = pE(a)s o (0) = vqR. (35) 

The quantity vq is the average shot noise current (in amperes if q is 
measured in coulombs) flowing through R ; and V ac is the average IR 
drop across the resistance. 

The value vqR for V 1Kr {t) can also be obtained from equations (16) 
and (13), 

= vE{a) [ dr 2 W + nT, T ), (36) 

•'o n = -oo 

= vE(fl)C' l h = vqC-'h = vqR, 

where the expressions (24) and (25) for h(t, t) are used in summing 
the series and evaluating the integral. 

The values of the higher order cumulants Ki(t) follow almost im- 
mediately from equation (36). First observe that the expression (15) 
for Ki{t) can be obtained from the expression (13) for (y(t)) (= Ki(t)) 
by replacing E (a), h(t + nT, t) by E(a l ), h l (t + nT, t), respectively. 
Furthermore, h l {t + nT, t) can be obtained from h(t + nT, t) by 
replacing C _1 and y by C~ l and ly, respectively. Therefore from equa- 
tion (36), 

Kl (t) - uE(a')C- l /(ly) = vq l C- l /{ly). (37) 

In particular, the variance of the distribution of the ensemble of 
V(t)'a at time t is 

(V'V)) - (V(l)Y = k,(/) = vq 2 C~ 2 /(2y) = ^ V Ao . (38) 

The fact that this does not depend on t shows that the mean square 
value of the fluctuation about F dc is also qV dc /(2C) : 

(V(t) - V dc ) 2 = K(t) = ^V de = 1^- (39) 

Equation (31) leads to the equation 
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ln<p(z) = T.K l {t)(Sz) l /l\, 

2 = 1 

= "- ± ^^ . (40) 

ZQ/C 



= - / (e' e - 1) dd/d, 
7 Jo 



for the characteristic function <p(z) of the distribution of the ensemble 
of V(t)'s at time t. The probability density of the distribution is 
given by 

± f <p(z)e" v ' dz (41) 

where In <p(z) can be expressed in terms of sine and cosine integrals. 
The integral (41) also gives the probability density of the value of a 
particular member of the ensemble at a time selected at random. 

The power spectrum W Vn (/) of V N (t) = V(t) - V dc is obtained by 
substituting the value (31) of s(f, t) in (8). 

Wy„(f) = V -£ f T \s(i,r)\ 2 dr, 

1 Jo (42) 

vq'H-' „ , T , (1 - bz a )q - z'-^yjy - to) 

= r+W Real r + ni - bzW(y + ^ . 

where ,., = 2tt/, y = 1/RC, and z and b are given by (30) : 

An outline of the evaluation of the integral is given in Appendix A. 
The curves plotted in Fig. 3 were computed from equation (42). It 
can be shown that 

W VN (0) = vq 2 R 2 [2 -a + hT(l - a)\\ + 6)(1 - b)' 1 }; 
W VN (i) ~* vq 2 RVa/i/, as / -> oo ; (43) 



v q 2 R 2 /a 



In Fig. 3, the quantity oiWv N {1)/{v<fR 2 ) is plotted as a function of 
u/(ya) = w RC/a = 27r/ RC/a. The parameters are a and 
7T = T/(RC). These coordinates were chosen because the exact com- 
putations made from equation (42) give nearly the same values as does 
the last approximation (T — > 0) in (43) for values of yT less than, say, 



PERIODICALLY VARYING SYSTEMS 2233 

5.0. From 



f 

Jo 



1 vq'R 



w ril (j) df = ino = |^ 



it can be shown that the area under any curve in Fig. 3 is v/2. As 
yT -* co, the ordinate at / = ultimately increases as 

a(2 - a) + 3p (1 _ a ) 2 

which, for yT fixed, has a maximum at 

_I . _i_ 

a 3 ~ l " 3yT 

The oscillations in the curves for the large values of y T can be cor- 
related with the oscillations in a (sin ///) 2 type of spectrum associated 
with the flat portions of length f 1 - a) T in V (t) . 

When the shot noise current generator in Fig. la is replaced by a 
zero-mean white noise current generator with a flat, two-sided power 
spectrum TF 7 (/) = N I0 , the dc component of V(t) becomes and 
V(t) is distributed normally about zero with variance 



(7 2 (/)> = V\t) = N I0 /(2yC 2 ). (44) 

This V(t) is an example of a stochastic process in which the distribu- 
tion of the ensemble at time t is normal and does not change with t, 
but the process is still not a stationary gaussian process because dV(t)/ 
dt is zero during the intervals that the switch is open. 

The power spectrum W y (f) is given by equations (42) and (43) 
with the multiplier v q 2 replaced by Nio- In the particular case in 
which the period T is small compared to the time constant RC, the 
last approximation given in equation (43) goes into 

™- i + f£ M - - (45) 

The Princeton Applied Research notes 3 obtained by Sell give results 
associated with this approximation. 

By Thevenin's theorem, the portion of Fig. la consisting of the 
infinite impedance shot noise current generator plus the resistance R 
shunting the generator can be replaced by a zero impedance shot 
noise voltage generator in scries with R. The currents and voltages 
in the remaining portion of the circuit are unchanged by this replace- 
ment. The voltage of the new generator is V g (t) = I(t)R; and its 
two-sided power spectrum W Vg (f) is flat and equal to N vu = 
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N I0 R 2 . The statistical results for the voltage V(t) across C can be 
expressed in terms of N ro by replacing N I() by N V o/R 2 (that is, vq 2 by 
N VQ /R 2 ). For example, equation (44) becomes 

T\t) = N vn /(R 2 2yC 2 ) = N V0 /(2RC). (46) 

V. RC CIRCUIT OF FIGURE 16 

The input shot noise current I(t) in Fig. lb is the same as in Fig. 
la, and is given by the sum (22) of impulses of weight q. The switch 
is in position a during the first part of the cycle, nT < t < nT + aT', 
and in position b during the second part, nT + aT < t < (N + 1)T. 

The condenser voltage V(t) increases more often than not during 
the first part of the cycle. It always decreases during the second part. 
Unlike the circuit Fig. la, V(t) has a periodic portion V veI (t) which 
includes variable terms in addition to F dc . 

Just as in Fig. la, we have a k = q and E(a) = q, E(a 2 ) = q 2 .The 
response h(t, t) at time t to a unit impulse of current arriving at 
r, where < t < T, is 

for - co < t < t, 
C~ l exp [-y(t - r)] for < r < aT and t < t, 

for aT < t < T and aU t. (47) 

As before, y = 1/(RC) and 

V{1) = E qh(t, t h ), (48) 

The Fourier transform of h(t, t) is 

s(f, r) = I™ e- i " t C- l e- y ' l - r) dt, 

= ^f^ , co = 2*1; 
y + ice 

for < t < aT, and s(f, r) = for aT < r < T. The integral 
s (f) used in computing V VCT (t) in V(t) = V N (t) + V pcr (t) is 



1 f T 
So(f) = 7p J s(1, t) dr, 



= (1 - e- iuaT )/[ia>TC(y + to)], (50) 

s (0) = a/Cy = oR. 
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The dc portion of Vpe r (t) is 

V dc = vE(a)s o (0) = vqaR 
and, from the general expression (10) for V^ T {t), 

V* n (l - e"' 
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(51) 



F p „(/) = 7 dc + 2Real £ - 
By working with 



i(a/y) 



UtiOUL 



_ <d = 2xm/T 



VwM = (V(t)) = »q jt [ Ht + nT, r) &x 



(52) 



(53) 



it can be shown that T 7 per (£) increases from A exp (— yT) at t = 
to A exp {—yaT) at t = aT, and then decreases to A exp (—yT) at 
t = T and so on, where 



A = 



V* n e yaT - 1 



(54) 



a 1 - e^ r 

The power spectrum Wvn (/) of the noise portion V N (t) of 7(0 is 
given by equation (8) and the expression (49) for s(f, t). 



W VN (f) = 



vE(a 2 
T 



2/-Y-2 



vq'C 



T 

2/-J-2 



/: 



\s(f,r)\ 2 dr t 

r dr 
T 2 + co 2 ' 



co = 2tt/; 



(55) 



= ^J^TI = RqV d ./[l + (co RC) 2 ]. 
7 ~r co 



Integrating W Vll (j) f rom / = — °° to / = + 00 shows that the time 
average of V£(t) is 



n(o = ^ v dB 



(56) 



just as in the case of Fig. la [see equation (39)]. However, in Fig. 
la, V ac = vqR; whereas in Fig. lb, V ac = vqaR. 

When the shot noise current generator in Fig. lb is replaced by a 
zero-mean white noise current generator with fiat power spectrum 
Wi(f) — NiOi ^ ne periodic component V peT (t) vanishes and the power 
spectrum of V(t) is obtained by replacing vq 2 in equation (55) by N n : 



Wy(fl = W VN (i) = Nr 



C 



2 I 2 » 

7 + co 



co = 2t/. 



(57) 
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The time average of V 2 (t) obtained by integrating equation (57) is 

aR 



V 2 (t) = N !n ~ (58) 

Although the periodic component V^M = (V(t)) is zero, the ensemble 
variance (V z (t)) at time t is a periodic function of t. It may be cal- 
culated from the second of equations (21) in which h 2 (t, t) is ob- 
tained by squaring the expressions (47) for h (t, r) . 

VI. THE ENSEMBLE AVERAGE (y(t)) 

In this section and the two following ones, the arguments used to 
deal with shot noise will be used to determine the power spectrum and 
the moments (more precisely, the cumulants) of the distribution of the 
output y(t) of the periodically varying system shown in Fig. 2. The 
input x(t) is taken to be shot noise consisting of a train of randomly 
arriving impulses. 

Let the system of Fig. 2 start operating at time t = and run to t = Tx 
where T t = NT with N » 1. Let the number of impulses arriving in 
< t < 7\ be the random variable K, and let the input be 

x(i) = X> t S(/- t k ), K±l; 

(59) 
x(t) = 0, K = 0; 

where, as in equation (4) , the impulse amplitudes a k are independent 
random variables with probability density q(a) and expected value 

E(a k ) = E(a), E(a 2 k ) = E(a 2 ). (60) 

The arrival times t 1} t 2 , ••• t k are independent random variables with 

Prob [t < U < t + dt] = dt/T, . (61) 

The number of arrivals K has the Poisson distribution 

Prob [K = L] = (/T0 L e-' rt /L\, 

E(K) = vT, , (62) 

E(K 2 - K) = (vTJ 2 , 

where v is the expected number of arrivals per second. 
The output produced by the input (59) is 



y(t) = Ea»ft(U), £fc 1; 
y(t) = 0, K - 0. 



(63) 
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When t is fixed, y(t) may be regarded as a random variable since 
it depends on the random variables K, a k , t k . The Ith moment of the 
distribution of y(t) is the ensemble average (y l (t)). Usually (y l (t)) 
will depend on t and be periodic with period T. We shall be con- 
cerned with the first moment (y(t)) in the remainder of this section. 

When the right side of the first part of equation (63) is averaged 
over the ensemble of a k 's, it becomes 

E(a)52h(t,t k ), K^l. (64) 

Averaging this over the ensemble of t k '$ gives 

E{a) f) jjr f T ' dt k h(l, t h ) = KE(a) ±- [ ' dt k h(t, t k ) (65) 

*-l M Jo * » "0 

where use has been made of the fact that all of the terms in the 
series on the left are equal. Finally, averaging over the ensemble of 
K's with the help of E (K) = vT 1 gives 

{y{t)) = vE(a) r dt k h(t,t k ). (66) 

Jo 

Dividing the interval (0, T x ) into N equal intervals of length T, 
setting tie = nT + r, and using the periodic property h(t + nT, r + 
nT) = h(t, T ) leads to 

(y(t)) = uE(a)Z f dt k h{t,t t ), 

n-0 JnT 

= uE(a) £ f dr h(t -nT + nT, nT + r), (67) 

= vE{a) £ / drh(t -nT, r). 

n-0 Jo 

Equation (67) holds when the system starts operating at t = 
and stops at t = T x . The following heuristic argument suggests that 
when (i) the system runs from t = -co to +co, and (ii) h(t, t) is 
such that only recent arrivals are of importance in determining the 
present state of the system, the analogue of equation (67) is 

<y(/)> = uE(a) jl f dr h(t - nT, r). (68) 

„=-co Jo 

We assume that, for < t < T, h(u, r) becomes negligible when 
Iwl > mT where m is a small integer. We define t to be in the "in- 
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terior" of (0, T x ) when 

mT < t < T t - mT. 

If t is in the interior of (0, Ti), the summation in equation (67) 
can be written as 

E= £ = E 

n-0 \l-nT\<mT n--co 

because h(t - nT, t) is negligible except when \t — nT\ < mT. Hence 
when t is in the interior of (0, jTi) and the system runs from to 7A 
< y(t) > is given by both (67) and (68). 
In the interior of (0, Ti) the starting and stopping transients near 

and Tj have died out, and y(t) is the same irrespective of whether 
the system runs from to T t or from — oo to + oo . Hence when t is in 
the interior of (0, T-i) and the system runs from -co to + °o, (y(t)) 
is again given by both (67) and (68) . 

The right side of equation (68) is a periodic function of t of period 
T. Physical considerations suggest that when the system runs from 
— oo to +oo (y(t)) is also a periodic function of period T. Since (y(t)) 
and the right side of equation (68) are equal when t lies in the in- 
terior of (0, T-i) (which extends over more than one period), it is 
plausible to say that the equality holds for all values of t. This is 
what we wished to show. 

Equation (68) appears as equation (13) in Section III. The sign 
of the index of summation n has been changed to make it easier to 
apply the formula. 

VII. THE CUMTJLANTS FOR y (t) 

The Ith. moment (y l (t)) may be expressed in terms of the first I 
cumulants ki (£) , ••• K t (t) of the distribution and conversely. For 

1 = 1 and I = 2. 

kS) = (y\t)) - (y(t)) 2 . 
The cumulants are defined by 

In v(z) = T,Ki(t)(iz) l /l\ (70) 

where <p(z) is the characteristic function 



(exp [izy(Q]) = \ exp 
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v (z) = (exp [trfO]). (71) 

The method of averaging over the ensemble used in the preceding 
section to obtain (y(t)) will now be applied to calculate (exp [izy(t)]). 
We have, because of the independence of the a k 's and t k 's, 

K 

iz X aji(t, t k ) 

L fc=i 

- E ^T «~""<«P [fcojkft «]>*, (72) 

A'-n A I 

= exp [-//Z\ + >#\<exp [tn^(/, **)]>]. 

Therefore, upon using the definition (71) of ?(z) and the probability 
densities of a k and t k , 

da k q(a k )J jr exp [tzo^, /*)]• (73) 
Expanding both sides in powers of 2 and equating coefficients of 



«,(/) = " / rfa * ?(«*)«! / d/* A'(<, 4), 
= i/£(a') [ ' dt k h\t,t k ). 

Jo 



(74) 



When Z = 1, equation (74) reduces to equation (66) for (y(t)). 
The steps that lead from equation (66) to the final expression for 
(y(t)) carry (74) into 

*,(/) = vE(a l ) £ ( dr A'(/ - nT , r). (75) 

This appears as equation (15) in Section III with n replaced by —n. 

VIII. THE POWER SPECTRUM OF y(t) 

When h(t, t) is such that y(t) has the two-sided power spectrum 
W y (/) , it is given by 4 



W W (D - limit<|5(/,r 1 ) I 2 )/? 7 , (76) 



where 
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S(1, T,) = S(j, T, ;K;a x , 


■ • ■ , a K ; /i 


= C dte- iat y(t), 

Jo 


co = 2tt/; 


= Jfl t dt e~' 

A-=l Jo 


"'h(t,t k ); 



(77) 



>Ti-lk 






In the derivation of equation (68) for (y(t)), the limits of sum- 
mation n = 0, n = N—l were replaced by n = —cc,n= co.In much 
the same way, we assume that in (77) the limits of integration — t k , 
T] — t k can be replaced by — cc, +oo in all but a negligible fraction 
of the terms (those with t k near or T x ). This presupposes a suf- 
ficiently rapid decrease in the value of \h(t k + u, t k )\ as |w| — > °o. 
Heuristically, we picture h (t k + u, t k ) as being negligible except when 
u is small. When 7\ is very large, most of the t k 's and {T-^ — t k )'s 
will be large. Consequently, for most of the t k 's, h(t k + u, t k ) will be 
negligible when u is less than —t k or greater than T — t k . 

This assumption allows us to replace equations (76) and (77) by 

W v (j) = limit <|S.(/,Z\) | 2 >/7\ (78) 

and 

£.(/, I\) = T,a k [ d,ue- iwUk+u) h{t k + w, 4), 

A" 
= X) fl * S (/. <0l 

where 

s (j t t) = J d/e- iut h(t, t). (80) 



(79) 



(81) 



From equation (79) 

I 5.(/,ro I 2 = s.(f f roflftf, ro, 

K A' 

= EL a*Ojs(/, <*)**(/i <j), 

where the star denotes conjugate complex. The terms in equation (81) 
can be divided into two types. For Type I, I = k, and for Type II, 
I ¥= k. It is convenient to take their ensemble averages separately. 
The typical Type I term is 
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al | s(f, t k ) | 2 . (82) 

There are K terms of Type I in the double sum (81), and all of them 
are of the form (82). Therefore, when use is made of E(K) = vT lt 
the contribution of the Type I terms to (!S (/, T^)) 2 ) is found to be 



vE(a 2 ) f ' dr\ s(j, r) \\ 

•'0 

The typical Type II term in (86) is 

a k a lS (j, t k )s*(j, t,), I ^ k. 
When averaged with respect to a,,-, a,, t k , t x it becomes 

% dh 



(S3) 



E{a) J l ^s(J,t k ) 



(84) 



There are K 2 — K terms of Type II in the double sum (81) and all of 
them have the average value (84). Therefore, when use is made of 
E(K 2 - K) = V 2 T\ , the contribution of Type II terms to < | S a (f, TJ | 2 > 
is found to be 



(85) 



vE{a) drsij, r) 



Adding the contributions of Type I and Type II, and inserting the 
resulting expression for (|S (/, 7\)| 2 ) in equation (78) for the power 
spectrum gives, with « = 2-n-f and s(/, r) given by (80), 

WJj) = limit ^ \vE{a 2 ) C dr | s(j, r) \ 2 

T - !— CD J 1 L ''0 

4- vE{a) f ' dr s(j, t) (86) 

Jo 

provided s(f, r) [i.e., h(t, t)} is such that the limit exists. If, for 
certain frequencies, the function of 7\ following the limit sign ulti- 
mately increases linearly with T,, W y {f) has an infinite spike at these 
frequencies. This means that y(t) has sinusoidal components at these 
frequencies. 

So far in this section, the time variation of the system has not 
been assumed to be periodic. Now we apply (86) to the case in which 
the system varies periodically with period T and, in accordance with 
equations (3) and (80), 



h(t - nT + nT, t + nT) = h(t - nT, r), 

s(i,r + ?iT) =e- iunT s(f, r). 



(87) 
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In (86) set T x = NT and let N -» oo. Then 

Yj^' dr\s(1,r) | 2 = |jf r dr\s(f,r)\ 2 , 






(88) 



= T«o0) 



1 - e—* T 

1 - e- uT 



where 



So(/) =|^ rfrs(/,r), co = 2rf. 



(89) 



The contribution of the second term in (86) contains the factor 



T 

limit T7 



1 - c-'"" 
1 - e - iw: 



= limit T7 



sin 



oNT 



sin 



//' 



(90) 



m 



= z */-i . 



T 



where the last step follows from the relations used in the proof of 
Fejer's theorem in the theory of Fourier series. When these results 
are used in equation (86), it goes into 



W v (f) =vE(a 2 )^f o T dr\s(f,r) 



+ v 2 E\a) Z S(/-f 



m 



So 



(91) 



Equation (91) shows spikes in W v (f) at / = m/T where m is an 
integer. The spike at / = corresponds to the dc component y Ac of 
y(t), and the spikes at ±m/T to the sinusoidal component 

A m cos [2vm(t/T) + d m ] (92) 

in y(t). The expression (91) for W y (f) shows that the (time) average 
powers in these components are 



yl = [vE(a)s o (0)]\ 

\Al = [uE(a)] 2 [\ s (-m/T) \ 2 + | s (m/T) | 2 ], 
= 2[vE(a) [ s Q (m/T) |] 2 . 



(93) 
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Equations (93) tell us nothing about the sign of 2/*. or about the 
phase angle 6 m . One of the several ways to get this information is 
to imagine y(t) expanded in a Fourier series of long period T if 

V(t) = J^Cnexpii&rnt/TJ, 
c n = jrf'dt y(t) exp (-itont/TJ, 

= yAt,' t ) ■ (94) 

~ J_ Q (iL t 



where we have used equations (77) and (79) for S(j, Ti) and its ap- 
proximation S a (f, Ti). The expression (91) for W v (f) shows that the 
c„'s may be divided into two classes; those corresponding to the fre- 
quencies n/T x = m/T, i.e., n = mN (discrete sinusoidal components) 
and those corresponding ton ^ mN (noise). For the first class, c„ is 
0(1) and nearly the same for most y(l)'s of the ensemble. For the second 
class, c„ is 0(7Y*) and varies greatly from member to member. 

To obtain the discrete sinusoidal component in y(t) of frequency 
m/T, we set n = mN in equation (94) and apply the procedure used 
in Section VI (to obtain (y(t))) to average c n over the ensemble. 

Wb—r - jrE(K)E(a) jT* |*s(f • '*) ' 

= vE(a)T £ jT exp I ^ f°\~f) ' * ' 

= vE(a)s (m/T), 

where we have used equations (88) and (89) with w = 2-rrm/T. We 
therefore write y(t) as the sum of a noise component yx(t), con- 
sisting of the sum of terms of the second class, and a periodic com- 
ponent y petit), consisting of the sum of terms of the first class: 

y(t) = VM + 2/perW- (96) 

The power spectrum of yx(t) is the first term in the expression (91) 
for W u (t): 
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W VN (f) = vE{a-) | f^ dr | s(f, r) | 2 . (97) 

The periodic component is, from (95), 

?/per (/) = vE(a) J2 So(m/T) exp [i2*mt/T]. (98) 

The parts y s (t) and y vor (t) of y(t) arc related to the ensemble 
averages by 

2/ P er(0 = (V(t)) = «l(0, (99) 

<</*(0> = (y\t)) - W)) a = *»(*)• (ioo) 

Equation (99) can be proved by showing that the with Fourier coef- 
ficients of 7/ P er(0 and <i/(0> are equal for all integers m, i.e., by 
showing that 

uE(a)s (m/T) = ± f (y(t)) exp (-itormt/T) dt. (101) 

When the series (68) for (y(t))is substituted on the right, the summation 
and the integration with respect to t from to T combine to give an 
integral in t with limits ± « . This integral can be evaluated with the 
help of the integral (80) for s(/, t) and leads to the verification of (99). 
Equation (100) follows from the ensemble average of the square of 

y*(t) = y(t) - y»M = 2/(0 - <v(0>. 

Setting I = 2 in the expression (75) for K t (t) and using (100) gives an 
expression for the ensemble average of y£(t) at time t, 

(yM) - « 2 (0 = vE(a 2 ) E f h\t - nT, r) dr. (102) 

„=_co Jo 

It follows from (102) that when the variance (yj&t)) varies with t, it 
varies periodically with period T. When equation (102) is averaged over 
a period and use is made of the ergodic relation (2), we get the time aver- 
age 

VW) = WO) = ^ ( dr £ dt h\t, r). (103) 

From the expression (97) for W VN {j), we get a second expression for 

yW) 

yW) = £ W VN (j) dj = V ^£ 1 [ dr /_" df | *(/. r) | 2 . (104) 
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The equality of (103) and (104) can also be proved directly by using 
the Fourier integral (80) relating s(/, t) and h{t, t). 



IX. WHITE GAUSSIAN NOISE INPUT 



Let the input x(t) of the periodically varying system shown in 
Fig. 2 be white gaussian noise with zero mean. Here we show that 
the output y(t) has no dc or sinusoidal components, and that the 
power spectrum of y(t)is 



W,(f) = yC \ s(/ ' t) I" d " 



(105) 
< F and 



where the power spectrum of x(t) is W x (f) = N for 
WAD = for |/| > F with F -> oo. 

Consider Fig. 4 in which an ideal low pass filter which passes only 
the frequencies |/| < F has been inserted between the input and the 
periodically varying network specified by h(t, t). 

When x{t) is a unit impulse applied at time t, x(t) = 8(t — r). the 
filter output at time t = t\ is 

sin 2ttF(^ - r) 

Ah) = T. ^ , 

7T(/i — T) 

and the system output at time t is 



(106) 



y(t) = [ h(t, /,) 



sin 27rF(/, - r) 



dl x . 



(107) 



7r(/x - r) 

Thus, when h(t, ti) satisfies conditions associated with the Fourier 
integral theorem, y(t) tends to h(t, t) as F — > °o ; a result which follows 
immediately from physical considerations. 

Take x(t) to be the shot noise given by (4) in which, for given values 
of A 7 ",, and v, a k — ±(N /v)* with equal probability. Then 

vE{a) = vE{a k ) = 0, 



vE(a 2 ) = vE(al) = N , 
and the filter output is the zero-mean shot noise 

, A ^ sin 2irF(t - 4) 
with the power spectrum 



ll'..(7) = vE(a 2 ) \f_ 



\N , 



sin '2wFt _?w/ ,, 
— e at 

■Kl 

I <F; 
I > F. 



= 27r/; 



(108) 



(109) 



(110) 
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FILTER 

lfl<F 



Z(t) 
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h(t,r) 



y(t) 



Fig. 4 — Conversion of shot noise x(t) to white noise z(t). 

Now hold F fixed and let v -» oo. The individual pulses comprising 
z(t) become smaller and smaller, and overlap more and more. In the 
limit z(t) becomes zero-mean gaussian noise with the power spectrum 
(110). 

Finally, let F -» oo. Then z{t) becomes white gaussian noise with 
the flat power spectrum W-tf) = N . According to equation (107), the 
response of the Fig. 4 system at time t to a unit impulse applied at 
time t tends to h(t, t) as F -» co. Therefore, the results obtained in 
Sections VI, VII, and VIII for shot noise input in Fig. 2 are carried 
into corresponding results for white noise input (i.e., x(t) in Fig. 2 
is white gaussian noise) by the substitutions (108), namely vE(a) 
= 0andvE(a 2 ) = N n . 

Setting vE(a) = in equation (98) for y pcr (t) shows that y ver {t) is 
zero for zero-mean white noise input. Consequently, y(t) contains no 
dc or sinusoidal components. 

Setting vE(a) = 0, and vE(a°-) = A r n in equation (91) for W v (f) 
shows that the power spectrum of y(t) is given by equation (105) 
when the input is white gaussian noise. Furthermore, y(t) is composed 
entirely of y N (t) ; and equations (102), (103), and (104) become 



{y\t)) = N £ f T h\t - nT, r) dr, 
7U)=^f o dr f_Jth\t,r), 

= Ylo dT Ji diHh T)|2 - 



(HI) 
(112) 



The fraction of time any particular member of the ensemble of outputs 
spends in the infinitesimal interval Y < y{t) < Y + dY is 



dY 
T 



f dt[2Tr(y 2 (t))]- l > exp [- F7(2(?/ 2 (0))] (H3) 

Jo 

where (y 2 {t)) is the function of t defined by equation (111). 
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APPENDIX A 

The Power Spectrum for Figure la 

Here we give some of the steps leading from the first line to the second 
line of equation (42) for W Vs (f). The first line is 

W VN (f) = V -£[ T \s(1,r)\*dT (114) 

where s(/, t) is given by equation (31). Multiplying (31) by its com- 
plex conjugate gives 

,„ v, a <r a , c-wy \ z-z a 

Hh r)\ - y2 + w 2 + j (t + T-j^p | x _ hz 

+ 2Reai r g "Xrivl ( ^Ll - < 118 > 

L(t — ua)(i - bz )(y + «w)M J 

Then 

I | S (/, r)| rfr - ^^5 \*T + 2w2 |j _ te | 

+ 2Real ^ , "';- 1 >^-^ ) l- (H6) 

(1 — &2)(7 + Zco)(2co) J 

Upon introducing the values b = exp (— yaT), z = exp (— i*oT) t and 
using the identity 



\z — z 



= -Real ^T^!-^ (117) 

1 — 02 



the quantity within the square brackets in equation (116) becomes 

aT + Real o - Wi- f~)y(y - <») (118) 

(1 — 60)0) (7 -f lu>) 

and thus leads to the expression of Wy M (f) g iven b Y the second line of 
equation (42). 
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